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Popular Summary 

AIRS was launched on EOS Aqua on May 4, 2002, together with AMSU A and HSB, to 
form a next generation polar orbiting infrared and microwave atmospheric sounding 
system. The primary products of AIRS/AMSU are twice daily global fields of 
atmospheric temperature-humidity profiles, ozone profiles, sea/land surface skin 
temperature, and cloud related parameters. Also included are the clear column radiances 
used to derive these products which are representative of the radiances AIRS would have 
seen if there were no clouds in the field of view. All products also have error estimates. 
The sounding goals of AIRS are to produce 1 km tropospheric layer mean temperatures 
with an rms error of IK, and layer precipitable water with an rms error of 20 percent, in 
cases with up to 80 percent effective cloud cover. The products are designed for data 
assimilation purposes for the improvement of numerical weather prediction, as well as for 
the study of climate and meteorological processes. With regard to data assimilation, one 
can use either the products themselves or the clear column radiances from which the 
products were derived. 


A post-launch algorithm, referred to as AIRS Version 4.0, has been used by the Goddard 
DAAC to analyze and distribute AIRS retrieval products. In this paper, progress is 
shown toward the AIRS Version 5.0 algorithm which will be used by the Goddard 
DAAC to analyze past and future AIRS/AMSU data starting late in 2006. A new 
methodology has been developed to provide accurate case by case error estimates for 
retrieved geophysical parameters and for the channel by channel cloud cleared radiances 
used to derive the geophysical parameters from the AIRS/AMSU observations. An 
accurate knowledge of individual error estimates enhances the value of the retrieved 
products, both from the data assimilation and climate assessment perspectives. These 
error estimates are in turn used for quality control of the derived geophysical parameters 
and clear column radiances. Version 5.0 retrieval accuracy and spatial coverage of quality 
controlled retrieval products are shown to be superior to those obtained using Version 
4.0. 
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ABSTRACT 

AIRS was launched on EOS Aqua on May 4, 2002, together with AMSU A and HSB, to form a next generation polar 
orbiting infrared and microwave atmospheric sounding system. The primary products of AIRS/AMSU are twice daily 
global fields of atmospheric temperature-humidity profiles, ozone profiles, sea/1 and surface skin temperature, and cloud 
related parameters including OLR. The sounding goals of AIRS are to produce 1 km tropospheric layer mean 
temperatures with an rms error of IK, and layer precipitable water with an rms error of 20 percent, in cases with up to 80 
percent effective cloud cover. The basic theory used to analyze AIRS/AMSU/HSB data in the presence of clouds, called 
the at-launch algorithm, and a post-launch algorithm which differed only in the minor details from the at-launch 
algorithm, have been described previously. The post-launch algorithm, referred to as AIRS Version 4.0, has been used 
by the Goddard DAAC to analyze and distribute AIRS retrieval products. In this paper we show progress made toward 
the AIRS Version 5.0 algorithm which will be used by the Goddard DAAC starting late in 2006. A new methodology 
has been developed to provide accurate case by case error estimates for retrieved geophysical parameters and for the 
channel by channel cloud cleared radiances used to derive the geophysical parameters from the AIRS/AMSU 
observations. These error estimates are in turn used for quality control of the derived geophysical parameters and clear 
column radiances. Improvements made to the retrieval algorithm since Version 4.0 are described as well as results 
comparing Version 5.0 retrieval accuracy and spatial coverage with those obtained using Version 4.0. 
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1. INTRODUCTION 

AIRS was launched on EOS Aqua on May 4, 2002, together with AMSU A and HSB, to form a next generation polar 
orbiting infrared and microwave atmospheric sounding system. 1 The primary products of AIRS/AMSU are twice daily 
global fields of atmospheric temperature-humidity profiles, ozone profiles, seadand surface skin temperature, and cloud 
related parameters including OLR. Also included are the clear column radiances used to derive these products which are 
representative of the radiances AIRS would have seen if there were no clouds in the field of view. All products also have 
error estimates. The sounding goals of AIRS are to produce 1 km tropospheric layer mean temperatures with an rms 
error of IK, and layer precipitable water with an rms error of 20 percent, in cases with up to 80 percent effective cloud 
cover. The products are designed for data assimilation purposes for the improvement of numerical weather prediction, as 
well as for the study of climate and meteorological processes. With regard to data assimilation, one can use either the 
products themselves or the clear column radiances from which the products were derived. 

The basic theory used to analyze AIRS/AMSU/HSB data in the presence of clouds, called the at-launch algorithm, and 
that used in a post-launch algorithm which differed only in the minor details from the at-launch algorithm, have been 
described previously 2,3 . The post-launch algorithm, referred to as AIRS Version 4.0, has been used by the Goddard 
DA AG to analyze and distribute AIRS retrieval products. In this paper we show progress made toward the AIRS 
Version 5.0 algorithm which will be used by the Goddard DAAC starting late in 2006. A new methodology has been 
developed to provide accurate case by case error estimates for retrieved geophysical parameters and for the channel by 
channel cloud cleared radiances used to derive the geophysical parameters from the AIRS/AMSU observations. These 
error estimates are in turn used for quality control of the derived geophysical parameters and clear column radiances. 
Improvements made to the retrieval algorithm since Version 4.0 are described as well as results comparing Version 5.0 
retrieval accuracy and spatial coverage with those obtained using Version 4.0. 



2. OVERVIEW OF THE AIRS TEAM RETRIEVAL ALGORITHM 


The AIRS team candidate Version 5.0 retrieval algorithm is basically identical to that described in Susskind et al. 2,3 The 
key steps are outlined below: 1) Start with an initial state, called the MW retrieval state, consistent with the AMSU A 
and HSB radiances 4 ; 2) Derive IR clear column radiances valid for the 3x3 AIRS Fields of View (FOVs) within an 
AMSU A Field of Regard (FOR) consistent with the observed radiances and the initial state; 3) Obtain an AIRS 
regression guess 5 consistent with r| 3 using 1504 AIRS channels; 4) Derive Rj 1 consistent with the AIRS radiances and 
the regression guess; 5) Derive all surface and atmospheric parameters using R| for 293 AIRS channels and all AMSU 
radiances; 6) Derive an improved set of clear column radiances R? using the AIRS physically retrieved parameters; 7) 

Repeat Step 5 using R^ to produce the final IR/MW retrieval state; 8) Derive cloud parameters and OLR consistent with 
the solution and observed R,; 9) Apply initial quality control, which rejects a IR/MW solution if the retrieved cloud 
fraction is greater than 90% or other relatively coarse tests fail. In the event that a retrieval is rejected initially, cloud 
parameters are determined consistent with the initial MW retrieved state and observed AIRS radiances. Otherwise, cloud 
parameters are computed based on the coupled IR/MW retrieval, and further quality control is applied to individual 
geophysical parameters. 

Candidate Version 5.0 differs from Version 4.0 with regard to some details in the physical retrieval steps. The major 
difference between candidate Version 5.0 and Version 4.0 is new methodology to determine accurate case by case, 
parameter by parameter, error estimates and, in addition, the use of these for quality control. The next two sections 
describe some of the changes in the details of the retrieval algorithm and give the methodology for generation of error 
estimates and their use in quality control. 


3. MODIFICATIONS TO THE VERSION 4.0 RETRIEVAL ALGORITHM 


The most significant 
improvement to the AIRS 
Science Team Version 4.0 
retrieval algorithm is the use of 
a new AIRS Radiative Transfer 
Algorithm (RTA) which 
contains improved charac- 
terization of atmospheric 
absorption characteristics, and 
more significantly, allows for 
effects of non Local 
Thermodynamic Equilibrium 
(non-LTE) which affects 
radiances in most shortwave 
temperature sounding channels 
during the day. Two important 
consequences of these 
improvements are that the 
needed systematic radiative 
transfer bias error correction 
coefficients (referred to as 
tuning coefficients) are now 
greatly reduced from those of 
Version 4.0, and in addition, 
many shortwave temperature 
sounding channels sensitive to 
non-LTE can now be (and are) 
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used effectively, both day and night, in the physical retrieval process. 

Figure 1 shows a typical AIRS brightness temperature spectrum and includes the channels used in Version 5.0 in 
different steps of the AIRS physical retrieval algorithm. The location and number of channels used are somewhat 
different from those of Version 4.0. The major difference is in the incorporation of the non-LTE temperature sounding 
channels in the temperature profile retrieval system, as indicated in Figure 1. 

The basic cloud clearing methodology used to determine R i is unchanged from that described in Susskind et al. 2,3 . In 
this methodology, a set of cloud clearing channels is used, in conjunction with an nth estimate of the geophysical state, to 
generate Rf . The cloud clearing channels used are sensitive to atmospheric absorption and emission at all levels of the 
troposphere, including emission from the earth’s surface. Inclusion of channels very sensitive to emission from the 
earth’s surface is useful to account for low clouds in the field of view, and a number of such (window) channels were 
used for cloud clearing over both land and ocean in Version 4.0. It has been subsequently determined that while surface 
channels improve cloud clearing ability over ocean, they have detrimental effects over land resulting from variable sub- 
pixel land skin temperatures and surface emissivities. Consequently, in candidate Version 5.0, cloud clearing channels 
with high sensitivity to the surface are.not used over land (but are still used over ocean). 


4. ERROR ESTIMATES AND QUALITY CONTROL 

Coupled AIRS/AMSU retrievals in the presence of broken cloud cover are usually highly accurate. Under some 
conditions, such as complete overcast, combined AIRS/AMSU retrievals cannot be performed at all. In cases of complex 
clouds or terrain, retrievals are of poorer quality. In the pre-launch version of the AIRS/AMSU retrieval algorithm, 
quality control was applied uniformly to the entire profile. If any geophysical parameter was considered to be of poor 
quality, the whole set of retrieval geophysical parameters was rejected and clouds were derived using the MW state of 
Step (1) above. This “one size fits all” approach led to significant compromises between desired spatial coverage of 
accepted retrievals and desired accuracy. In Version 4.0 3 , the combined IR/MW retrieval parameters is retained, and 
used to derive cloud parameters, as long as it is felt that the combined IR/MW retrieval (Step 7) is at least as accurate as 
the MW only retrieval (Step 1). This was considered to be true if the retrieved cloud fraction derived using the IR/MW 
state was less than or equal to 90% and the initial cloud clearing step was stable. If this test was passed (referred to as 
the Stratospheric Temperature Test), the temperature profile above 200 mb was considered acceptable. Constituent 
profiles (H 2 0, 0 3 , CO, and CH 4 ) were accepted if the Stratospheric Temperature Test was passed and additional slightly 
more stringent cloud clearing stability tests were also passed. The next level of test was applied to the temperature 
profile beneath 200 mb and above 3 km (the Mid Tropospheric Temperature Test). Finally, a more stringent test was 
applied to accept temperature profiles in the lowest 3 km of the atmosphere (Lower Tropospheric Temperature Test). 
Lower tropospheric temperatures are the most difficult to determine accurately, both because of effects of low clouds on 
the radiances and uncertainty and small scale variability in surface skin temperature and emissivity. Both concerns 
create greater problems over land than ocean. In response to this, the Lower Tropospheric Temperature Test rejected 
lower tropospheric temperature more often over land than over ocean in Version 4.0. 


4.1 Error estimates and quality control for retrieved temperature profiles and surface skin temperatures 

The Version 4.0 quality control tests each used thresholds for values of 12 different parameters Y k (k = 1,12) 
representative of residuals of internal convergence tests. In candidate Version 5.0, the case by case values of each of the 
parameters whose thresholds were used in the Version 4.0 acceptance tests, Y k , are used in the generation of error 

estimates of the individual retrieved parameters. In the case of either T(p) or T skin , we write 

5Ti=XM ik Y k 
k 


( 1 ) 



where 5Tj is the temperature error estimate, Y k is the value of the k th test, and M is a matrix with different values over 
ocean and land. Error estimates are, by definition, all positive. 


If one knows the actual errors, given by Tj _y. tRlth the matrix M can be determined in a straightforward manner, by 

finding M such that M minimizes the RMS difference of (ATj - SY l ) , where AT] = |Tj - Tj truth | . In order to generate M, 

we used Tj and Y k for all candidate Version 5.0 IR/MW retrievals (that is all cases passing the Version 4.0 
Stratospheric Temperature Test) on September 29. 2004, and used the colocated ECMWF 3 hour forecast used as truth. 
The accuracy of the error estimates, and of their use for quality control, was tested on global candidate Version 5.0 
retrievals run on January 25, 2003. 


4.1.1 Surface skin temperature quality control 


Ocean surface skin temperatures are measured very accurately from other EOS instruments such as MODIS and AMSR- 
E. AIRS ocean skin temperatures must be very accurate in order to provide additional useful information regarding sea 
surface temperature anomalies. In Version 4.0, sea surface temperatures were classified according to their ability to pass 
either a tight SST test (highest quality) or a standard SST test (good quality). Monthly mean products were generated by 
including all cases passing the standard SST test. In Version 5.0, we use the ocean skin temperature error estimate 
directly for quality control. We currently classify ocean skin temperatures as highest quality if the 5T skin < 1.0K and 

good quality if 8T skin < 1.25K . Figure 2a shows the spatial distribution of non-frozen ocean surface skin temperature 

errors for ascending (daytime) orbits on January 25, 2003 for all cases in which the combined IR/MW retrievals were 
produced. The predicted errors, obtained from Equation 1, are shown in Figure 2b. Figure 2d shows the difference 
between the predicted error and the absolute value of the actual error. The largest errors are somewhat under-predicted 
and the smallest errors over-predicted, but the spatial correlation (0.71) is very good. Figure 2c shows the spatial 
distribution of the errors for those sea surface temperatures classified as good (8T skin < 1.25K) . The current plan is to 
include these cases in the generation of the monthly mean SST product. 
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Figure 3 shows histograms of the distribution of quality controlled (both good and highest quality) ocean retrievals as a 
function of SST differences from ECMWF “truth” on January 25, 2003, obtained using Version 4.0 and candidate 
Version 5.0. The mean difference from ECMWF, the spatial standard deviation of the difference, the percent of all cases 
accepted, and the percent outliers (errors more than 3K from the mean) are indicated in the figure. Candidate Version 
5.0 has a higher yield than Version 4.0 for both the highest quality and the good quality retrievals. 

Equation 1 is also used to generate 8T skin over land and ice. A caveat here is that the values of the ECMWF T skin 
“truth” are considerably less accurate over land and ice than over ocean. Nevertheless, the procedure produces a 
reasonable spatial distribution of surface skin temperature error estimates over land and ice cases (not shown). These 
error estimates are not currently used for quality control of the land surface skin temperature, but are taken into account 
with regard to temperature profile quality control over land. 
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4.1.2 Temperature profile quality control 

As with surface skin temperature, case by case level by level error estimate for temperature profile are also obtained by 
equation 1. We use these error estimates to determine a case by case characteristic pressure Pgood’ down to which the 

profile is considered acceptable. We assume all IR/MW derived profiles are acceptable down to at least 70 mb. If the 
5T skin is less than 2K over either land or ocean, it is assumed that the cloud clearing is adequate to produce an accurate 

temperature profile and p„ CXKl is set to be the surface pressure p sur f . Otherwise, the characteristic pressure Pg OOC | is 
defined as the highest pressure (somewhere between 70 mb and p SLllf ) at which the error estimate at the next 3 pressure 
levels is not greater than a pressure dependent error estimate threshold. At the time of this paper, the error estimate 



thresholds are taken as 2. OK at 70 mb, 1.0K at p surf 12 , and 1.0K at p sur f over ocean, and 2K at 70 mb, 1.25K as 
p surf 12 , and 1 .5K at p surf over land, with values linearly interpolated in ^np at intermediate values. 

Figure 4a shows the differences of retrieved 300 mb temperatures from ECMWF “truth” for all ascending orbit retrieval 
IR/MW cases in January 25, 2003. Gray means missing data. This can be a result of orbit gaps, a missing granule (over 
central Africa), or (generally very cloudy) areas where successful IR/MW retrievals were not performed (such as off the 
northwest coast of the U.S.). The area weighted global mean of the error is - OIK, and its spatial standard deviation is 
1.54K. Figure 4b shows the predicted errors, and Figure 4d shows the differences between the predicted error and the 
absolute value of the actual error. The spatial correlation is 0.53, and the spatial standard deviation is 0.88, showing 
reasonable skill between the actual “error” (which may itself be incorrect due to errors in the truth), and the predicted 
error. Figure 4c shows the 300 mb error the quality controlled cases, i.e., cases in which Pg^ ^ 300 mb . The spatial 

distribution of accepted cases is quite comprehensive, and the standard deviation of the errors for accepted cases has 
dropped to 1 .1 IK. The largest “errors” for the accepted cases occur over Antarctica, Greenland, and Northern Siberia, in 
locations where (by definition), the error estimates are low. These are regions in which the ECMWF “truth” may be of 
poorer quality and actual errors may be less than the errors shown in Figure 4c. 
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Figure 5 shows the spatial distribution of quality controlled retrieved 700 mb temperatures and their errors vs. ECMWF 
“truth” for Version 4.0 and candidate Version 5.0 retrievals. Areas in which the surface pressure is less than 700 mb are 
not included in the figure. The global standard deviation of quality controlled errors is somewhat larger in candidate 
Version 5.0 than in Version 4.0. It is important, however, to note that the spatial coverage over land and at high latitudes 
is significantly higher in candidate Version 5.0 than in Version 4.0, with reasonable 700 mb temperature accuracies in 
these regions. 
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Figure 6 shows RMS differences from ECMWF “truth” for global quality controlled Version 4.0 and candidate Version 
5.0 retrievals, and the percent of all cases included in each set of statistics. The percent accepted at 70 mb represents the 
percent of all cases in which successful IR/MW retrievals were produced. Candidate Version 5.0 has a much higher 
yield beneath 200 mb than Version 4.0, with roughly comparable accuracy. Increasing spatial coverage of high quality 
retrievals is very important for both data assimilation purposes and climate and process studies. 


4.2 Error estimates and quality control for moisture profile 

The methodology used to generate error estimates for moisture profile is similar to that used for temperatures, but 
slightly different. Errors in the retrieved temperature profile and surface skin temperature will be major contributors to 
the errors in moisture profile. To reduce the dimension of die matrix M, we express the moisture profile error estimate of 
5qj at all pressures as a linear combination of 6 temperature error estimates 

&li=M ik 5r k (k = l,6) (2) 

where §T k corresponds to temperature error estimates at 150 mb, 260 mb, 500 mb, 700 mb, 850 mb, and 986 mb. 

In the case of water vapor profile, the reported error Sq.j corresponds to the percentage error of the retrieved water vapor 
column density in layer i. M ik is found which minimizes the layer i moisture weighted percentage error, PE; given by 

PEi = RMS 

In equation 3, the percent error is taken with respect to the average of the retrieved and true quantities to guard against 
very low “true” values and stabilize the problem. §q p determined using equation 2, is to be interpreted as the percent 
error of the retrieved value of q :i however. 

The moisture profile error estimates are used only for error estimation purposes and not for quality control. Quality 
control for moisture profile '.is identical to that used for temperature profile, i.e., the moisture profile is classified as 
acceptable down to the same pressure level, p go0 d > used to classify the temperature profile. 

Figure 7a shows the percentage error of the retrieved water vapor in the lowest lay er above the surface, which is roughly 
250 meters thick, with regard to ECMWF truth, for all IR/MW retrievals. Figure 7b shows the predicted fractional error, 
and Figure 7d shows the difference between the predicted fractional error and the actual error. Agreement is quite good, 
with a spatial correlation of 0.63. Figure 6b shows quality controlled fractional errors compared to ECMWF for the 
surface, which includes only those cases for which p good = p surf . 
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Figures 8a shows RMS global percentage error of 1km layer water vapor compared to ECMWF truth for quality 
controlled Version 4.0 and candidate Version 5.0 retrievals. As with candidate Version 5.0, Version 4.0 uses the same 
pressure dependent quality control for water vapor profiles as it does for temperature profiles. As with temperature 
profile, candidate Version 5.0 accuracy is comparable to that of Version 4.0, but with significantly greater spatial 
coverage. 
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4.3 Error estimates and quality control for clear column radiances 

Errors in cloud cleared radiances for channels i, Rj, come from two sources. Even if the cloud clearing process were 

perfect, Rj would have errors due to noise in the observed radiance for channel i, with noise characteristics NEANj . 
The cloud clearing process involves taking linear combinations of observed channel i radiances in 9 Fields of View and 
consequently introduces a case dependent noise amplification factor A. 2 Under these (perfect cloud clearing) conditions, 

the error in Rj would then be AxNEANj . The cloud clearing process is not perfect however and additional errors are 
introduced into Rj . These additional errors are the major cause of errors in the derived temperature profile. In- an 
analogous manner to what was done in generating the moisture profile error estimates, we model 5Rj according to 

SR* = AxNEANj + 1 M lk 8T k (4) 

l 

and the i th column of the matrix M (dimension 2386 x 6) is found by best matching RMS where Rj™ 111 i s 

the radiance computed using the ECMWF forecast as the truth. 

Figure 9a shows a portion sample of an AIRS cloud cleared brightness temperature spectrum, 0j, where 0j is given in 

brightness temperature units and is the temperature whose black body radiance is Rj . The spectrum of clear column 
radiance error estimates for this case, in brightness temperature units, is shown in Figure 9b. The major spatial 
absorption features shown in Figure 9a are the C0 2 absorption band, from 650 cm' 1 to 750 cm' 1 and the O s absorption 
band from about 990 cm' 1 to 1070 cm' 1 . Brightness temperatures correspond roughly to the temperature at the level of 
the absorption (or surface skin) at which most of the signal for that channel is coming from. The stronger the absorption 
in a given channel, the lower the brightness temperature for that channel. Some weak C0 2 and H 2 D absorption lines 
(locally colder features) are also found in the “window” regions between 750 cm' 1 and 990 cm' 1 , and 1070 cm' 1 - 1150 
cm -1 , which are somewhat less sensitive to radiation coming from the surface than the surrounding channels. Errors in 
the cloud clearing process generally result in increasing clear column radiance errors as channels see deeper into the 
atmosphere, with the largest errors for those channels most sensitive to the surface. The clear column radiance error 
estimate spectrum shown in Figure 9b is consistent with this expectation. 

Figure 10a shows the spatial distribution of the differences of the derived clear column radiances for the AIRS channel at 
724.52 cm* 1 from those computed using ECMWF as truth for all cases in which a successful IR/MW retrieval was 
produced. This channel is between C0 2 absorption lines, corresponding to a local maximum in the brightness 
temperature, and is primarily sensitive to atmospheric temperatures in the vicinity of 600 mb. There is a substantial 
negative bias due to insufficient cloud clearing in areas where poor retrievals were produced. Figure 10b shows the 
spatial distribution of the brightness temperature error estimates for this channel, and Figure lOd shows the difference 
between the error estimates and the absolute value of the “error”. The spatial correlation is very good, with a value of 
0.75, and the magnitude of the predicted and observed errors match closely as well. Indeed, most of the largest 
differences occur at high latitudes, where the ECMWF “truth” may be of poorer quality. In these areas, low errors are 
generally predicted, and large “errors” are found. Most likely, these apparently under-predicted errors result from errors 
in the “truth”, not in the clear column radiances. We use the predicted clear column radiance errors directly as quality 
control for the clear column radiances. Figure 10c shows the distribution of quality controlled clear column radiances, 

A 

retaining only those cases in which SRj was less than or equal to 1.0K. Most of the negative bias has been eliminated. 

The standard deviation of the quality controlled clear column radiance errors is 0.81K, which is not significantly above 
the channel noise. 
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Figure 1 1 shows a blow up of the global mean clear column brightness temperature spectrum and the quality controlled 
spatial standard deviation of the clear column brightness temperature errors obtained using candidate Version 5.0, which 

include only those cases in which 5Rj < IK, and obtained using Version 4.0. In Version 4.0, the mid -troposphere good 
criterion was used to accept clear column brightness temperatures and include them in the statistics. Also shown is the 
channel noise. The larger “errors” in clear column radiances are in fact a result of errors in the ECMWF “truth” 3 . 
Version 5.0 quality controlled clear column brightness are highly accurate, and should produce good results when used 
for data assimilation purposes. The user can employ tighter acceptance criteria if they so desire, increasing accuracy at 
the expense of spatial coverage. 
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